TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD 



FIELD OF THE INVENTION 

The present invention relates to an image 
processing apparatus and method and, more particularly, 
to color matching under different viewing conditions. 

BACKGROUND OF THE INVENTION 

A human color appearance model is so designed as 
to allow correctly predicting how a color is seen when 
a color chip having a field angle of 2° is given. 
Fig. 1 is a view showing the definition of a human 
visual field. A CIE 1931 standard colorimetric 
observer is applicable to the range of a field angle of 
1° to 4°. Therefore, this applicable region is divided 
into a stimulus region having a field angle of 2° or 
less, an adjacent region having a field angle of 4° or 
less, a background region from the adjacent region to a 
region having a field angle of 10°, and a surrounding 
region around this background region. Also, a visual 
field region including all these regions is an 
adaptation region. 

CIE CAM97s is a representative color appearance 
model, and in this model the following can be set as 
viewing condition parameters. 

La: Absolute luminance [cd/rn] in adaptation 



region 

Normally, 20% of white point absolute 

luminance in adaptation region 
XYZ: Relative XYZ value of color chip 
XwYwZw: Relative XYZ value of white point 
Yb: Relative luminance of background region 
Surround conditions: 

Average Surround (larger than a field angle 

of 4° of a color chip) 

Average Surround (equal to or smaller than 
a field angle of 4° of a color chip) 
Dim Surround 
Dark Surround 

Cut-Sheet Transparencies (on viewing box) 
The surround condition is Average if the relative 
luminance in the surrounding region is 20% or less of a 
white point in the adaptation region, Dim if this value 
is smaller than 20%, and Dark if this value is almost 
0%. 

A color appearance model is derived from 
experimental results using monochromatic color chips. 
Hence, no method has been established which determines 
viewing condition parameters applicable to an image 
having a plurality of colors. That is, the relative 
luminance Yb is set at 20% because neutral gray is 20% 
of a white point. 

Also, when a color appearance model is applied to 



an image, one viewing condition parameter is generally 
used for all pixels. 

When one viewing condition parameter is thus 
applied to all pixels, a visual effect between a single 
color and a background expressed on a rasterized image 
cannot be reflected on a color matching result. 

Furthermore, since an average viewing condition 
parameter is evenly applied to an image, no color 
matching result having high accuracy can be locally 
obtained. 

SUMMARY OF THE INVENTION 
The present invention has been made to 
individually or simultaneously solve the above problems, 
and has as its object to reflect a local visual effect 
between a single color and a background expressed on an 
image onto a color matching result. 

it is another object of the present invention to 
obtain an optimum viewing condition parameter of an 
image at a high speed. 

It is still another object of the present 
invention to execute processing of obtaining an image 
correction condition for a pixel of interest at a high 
speed by analyzing an adjacent region of the pixel of 
interest . 

In order to achieve the above objects, a 
preferred embodiment of the present invention discloses 



an image processing method of analyzing a pixel value 
of a pixel of interest and pixel values in an adjacent 
region of the pixel of interest, the adjacent region 
being formed by neighboring pixels of the pixel of 
5 interest, and setting an image correction condition, 
comprising the steps of: dividing an adjacent region 
of a first pixel of interest into a plurality of 
regions formed from pixel values in a scan direction 
and in a direction perpendicular to the scan direction, 
10 analyzing the pixel values in each of the divided 

regions, and holding an analysis result for each of the 
divided regions; obtaining an image correction 
condition for the first pixel of interest from the 
analysis result of each divided region belonging to the 
15 adjacent region of the first pixel of interest and 

correcting the first pixel of interest using the image 
correction condition; in order to obtain an image 
correction condition for a second pixel of interest 
moved from the first pixel of interest in the scan 
20 direction, executing analysis for a difference region 
between the first adjacent region and an adjacent 
region of the second pixel of interest on the basis of 
pixel values in a region which belongs to the 
difference region and is formed from pixel values in 
25 the scan direction and in the direction perpendicular 
to the scan direction, and holding an analysis result; 
and obtaining the correction condition for the second 
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pixel of interest from the analysis result of the 
region belonging to the adjacent region of the second 
pixel of interest and correcting the second pixel of 
interest using the image correction condition. 
5 Also, an image processing apparatus for 

performing color matching by using a human color 
appearance model, comprising: an input section, 
arranged to input a distance between an image and a 
viewer, and a resolution of the image; and a processor, 

10 arranged to define regions based on a plurality of 

field angles with respect to a pixel of interest on the 
image, on the basis of the input distance and 
resolution, thereby performing color matching, wherein 
the processor performs arithmetic operation for a 

15 difference region between the regions based on the 
plurality of field angles, which are generated by 
moving the pixel of interest, to obtain an arithmetic 
result for the regions based on the plurality of field 
angles after movement of the pixel of interest is 

20 disclosed. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 

25 the same or similar parts throughout the figures 
thereof . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a conceptual view showing the 
definition of a human visual field; 

Fig. 2 is a view for explaining the concept of 
color matching by CAM; 

Fig. 3 is a flow chart showing the process 
configuration of the first embodiment; 

Fig. 4 is a view for explaining the distance from 
a monitor screen or a printed product to a viewer; 

Fig. 5 is a view for explaining a method of 
calculating the diameters of a stimulus region, 
adjacent region, and background region from a distance 
D between an image and a viewer; 

Fig. 6 is a view showing a pixel of interest in 
an image and regions corresponding to different field 
angles ; 

Fig. 7 is a view showing lack of pixels in 
processing near the edge of an image; 

Fig. 8 is a flow chart showing the process 
configuration of the second embodiment; 

Fig. 9 is a view showing an arrangement in which 
a distance measurement sensor is placed on a monitor or 
a viewing box; 

Fig. 10 is a view showing a user interface for 
setting relative luminance values for lacking pixels in 
processing near the edge of an image; 

Fig. 11 is a conceptual view showing increasing 



the speed of detection of Ymax and Ymin in an adjacent 
region; 

Fig. 12 is a conceptual view showing increasing 
the speed of calculation of an average relative 
luminance Yb in a background region; and 

Fig. 13 is a view showing rectangles containing 
objects . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Image processing apparatuses according to 
embodiments of the present invention will be described 
in detail below with reference to the accompanying 
drawings . 
First Embodiment 
[Concept of Color Matching] 

Fig. 2 is a view for explaining the concept of 
color matching. 

In Fig. 2, reference numeral 11 denotes a 
conversion matrix or conversion lookup table (LUT) for 
transforming data depending on an input device into 
device-independent color space data which is based on 
the white point reference of environmental light at the 
input side; 12 , a color appearance model transform unit 
{CAM) for transforming the data obtained from the 
conversion LUT 11 into a human color appearance space 
JCh or QMh; 13, JCh (or JCH) which is a color 
appearance space relative to the reference white point 



of environmental light; 14, QMh (or QMH) which is an 
absolute color appearance space which changes its size 
in accordance with an illuminance level; 15, a color 
appearance model inverse transform unit for 
5 transforming the human color appearance space JCh or 
QMh into device-independent color space data based on 
the reference white point of environmental light at the 
output side; 16, a conversion LUT for transforming the 
data obtain from the inverse transform unit 15 into 
10 color space data depending on an output device; 17, a 
viewing condition parameter on the input side; and 18, 
a viewing condition parameter on the output side. 

Note that the input and output devices are not 
limited to color spaces such as RGB and CMY (K) , but can 
15 be arbitrary image input/output devices such as a 

digital still camera, digital video camera, monitor, 
and printer. Note also that a computer apparatus such 
as a personal computer is applicable to an image 
processing apparatus for executing color matching 
20 itself, but this function can also be imparted to the 
input/output devices. 

Generally, a white point of environmental light 
under viewing conditions is different from a white 
point of a standard light source when a color chip such 
25 as a color target or color patchTis measured. For 

example, a standard light source used in colorimetry is 
D50 or D65. However, environmental light when an image 
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is actually viewed is not restricted to D50 or D65 in a 
light booth but is often illuminating light such as an 
incandescent lamp or fluorescent lamp or mixed light of 
illuminating light and sun light. In the following 
explanation, the light source characteristics of 
environmental light under viewing conditions are D50, 
D65, or D93 for the sake of simplicity. In practice, 
however, the XYZ value of a white point on a medium is 
set as a white point. 

When CIE CAM97s, for example, is applied as a 
color appearance model, the viewing condition parameter 
17 on the input side and the viewing condition 
parameter 18 on the output side are as follows. 

La: Absolute luminance [cd/m ] in adaptation 
region 

XYZ: Relative XYZ value of color chip 
XwYwZw: Relative XYZ value of white point 
Yb: Relative luminance of background region 
Surround conditions: 

Average Surround (average, larger than a 
field angle of 4° of a color chip) 
Average Surround (average, equal to or 
smaller than a field angle of 4° of a color 
chip) 

Dim Surround (dim) 
Dark Surround (dark) 

Cut-Sheet Transparencies (on viewing box) 



Input device-dependent image data is transformed 
into a relative XYZ value under environmental light at 
the input side by the transformation LUT 11. 
[Process Configuration] 

Fig. 3 is a flow chart showing the process 
configuration of this embodiment. Although a practical 
hardware arrangement for implementing the process 
configuration will not be explained, this process 
configuration is implemented by supplying a program 
corresponding to the configuration to a personal 
computer or the like. 

First, a user inputs a distance D between an 
image and a viewer (S21) . As shown in Fig. 4, the 
distance between a monitor screen or a printed product 
and a viewer is 0.4 to 0.7 m. However, a given 
distance D can be set by user input. In this 
embodiment, D = 0.5 m is used as an example. Note that 
the set value of the distance D between an image and a 
viewer on the input side can be different from that on 
the output side. 

Next, the diameters of a stimulus region, 
adjacent region, and background region are calculated 
from the distance D between an image and a viewer. As 
Fig. 5 shows, the line of sight and the surface of an 
image presumably intersect at a substantially right 
angle. Therefore, a diameter Da of the stimulus region 
having a field angle of 2° or less, a diameter Dp of 



the adjacent region having a field angle of 4° or less, 
and a diameter Db of the background region having a 
field angle of 10° or less are as follows. 

Da = 2 x D x tan(l°) 

Dp = 2 x D x tan (2°) 

Db = 2 x D x tan (5°) 

If D = 0.5 m, Da = 17 mm, Dp = 35 mm, and Db = 87 

mm. 

The user inputs resolution R (pixels/inch) of an 
image (S23) . For example, this resolution R is 72 ppi 
for an image displayed on a monitor and 400 ppi, which 
is a printer resolution, for a printout image. In 
practice, the resolution R depends upon a resolution or 
a zoom ratio designated by an application or a device 
driver. Note that this resolution has the same value 
at the input and output sides. 

Subsequently, the numbers of pixels on the image 
corresponding to the stimulus pixel region, adjacent 
pixel region, and background pixel region are 
calculated (S24) . The numbers Dap, Dpp, and Dbp of 
pixels in the diameters of the stimulus region, 
adjacent region, and background region, respectively, 
are as follows. 

Dap = Da x R/0.0254 

Dpp - Dp x R/0.0254 

Dbp = Db x R/0.0254 

If D = 0.5 m and R = 72 ppi, Dap - 48.2, Dpp = 



99.0, and Dbp = 24 6.6. For simplicity, as shown in 
Fig. 6, assume a square region having 2n + 1 pixels (n 
is a positive integer) on each side. Length L of one 
side of this square region is calculated such that the 
area of a circular region and the area of the square 
region are equal. Since L = J~ n x D/2 = 0.886 x D, the 
side lengths of the individual regions are Lap = 43 
pixels, Lpp = 87 pixels, and Lbp = 219 pixels. If D on 
the input side and D on the output side are different, 
it is only necessary to calculate the number of pixels 
corresponding to the length of one side of each region 
independently for the input and output sides. 

The user then inputs white point absolute 

2 

luminance Law [cd/m ] of the adaptation region and 
absolute luminance Ls [cd/m 2 ] of the surrounding region 
on the basis of values indicated by a meter and the 
like (S25) . 

The white point absolute luminance of the 
adaptation region can 'be calculated by the absolute 

2 

luminance [cd/m] of a monitor white point in the case 
of a monitor, and by (illuminance [1ux]/tc on a printed 
product) in the case of a printed product. The 
absolute luminance of the surrounding region is 
strictly the absolute luminance of a region having a 
field angle larger than 10° with respect to a pixel of 
interest. For the sake of simplicity, however, this 
absolute luminance is in the case of a monitor the 
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ambient absolute luminance of the monitor, and in the 
case of a printed product the ambient absolute 
luminance of the printed product. Note that different 
values can be set as each absolute luminance in 
accordance with the viewing conditions on the input and 
output sides. 

Subsequently, the surround conditions are 
determined by, e.g., the following conditions (S26) . 
If 0.2 ^ Ls/Law, Average Surround 
If 0.06 < Ls/Law < 0.2, Dim Surround 
If Ls/Law ^ 0.06, Dark Surround 
If Ls and Law on the input side are different 
from those on the output side, the surround conditions 
are independently determined on the input and output 
sides . 

Next, a pixel of interest with respect to an 
input image is set (S27) . For example, the following 
processing is performed for all pixels from the upper 
left to the lower right of the image. 

First, whether the surround condition on the 
input or output side is Average Surround is checked 

(528) . If the condition is Average Surround, 
uniformity Sp in the adjacent region is calculated 

(529) . 

That is, in the adjacent region (including the 
pixel of interest and the stimulus region) having the 
side length Lpp, maximum and minimum Y values Ymax and 
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Ymin are calculated from the XYZ value of each pixel. 
Uniformity Sp = (Ymax - Ymin)/100 is then calculated. 
If, for example, Sp ^ 0.01, this adjacent region is 
regarded as a uniform region. If the adjacent region 
is considered to be a uniform region, Average Surround 
(larger than a field angle of 4° of a color chip) is 
applied as the surround condition; if the adjacent 
region is nonuniform, Average Surround {equal to or 
smaller than a field angle of 4° of a color chip) is 
applied as the surround condition. Note that if the 
distance D at the input side is different from the 
distance D at the output side, the ranges of the 
adjacent region are also different, so the calculations 
are independently performed on the input and output 
sides . 

Subsequently, in the background region (not 
including the pixel of interest, stimulus region, and 
adjacent region) having the side length Lbp as shown in 
Fig. 5, average relative luminance Yb of Y is 
calculated from the XYZ value of each pixel (S30) . If 
the distance D at the input side is different from the 
distance D at the output side, the ranges of the 
adjacent region are also different, so the calculation 
is independently performed on the input and output 
sides. 

Next, viewing condition parameters on the input 
and output sides are set (S31) . For example, if the 
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input side is an sRGB monitor (D65, Law = 80 [cd/m ] , 

2 

Ls = 4.074 [cd/m]), the output side is a typical 

2 

office environment' (D50, Law = 238.7 [cd/m ] , Ls = 

2 

47.74 [cd/m]), the distance D between an image and a 
viewer is 0.5 m on both the input and output sides, and 
the resolution is 72 ppi, the viewing condition 
parameters are as follows. 

Input-side viewing condition parameters: 

La = Law x 0.2 = 80 x 0.2 = 16 [cd/m] 

XwYwZw = D65 

Yb = average Y of input-side background 
region (one side = 219 pixels) with respect 
to each pixel of interest 

Surround condition: Dark Surround (Ls/Law = 
4.074/80 = 0.051) 
Output-side viewing condition parameters: 
La = Law x 0.2 = 238.7 x 0.2 = 47.74 
[cd/m 2 ] 

XwYwZw = D50 

Yb = average Y of output-side background 
region (one side = 219 pixels) with respect 
to each pixel of interest 
Surround condition: Average Surround 
(Ls/Law = 47.74/238.7 = 0.2) 
The average relative luminance Yb on the output 
side should be calculated from the XYZ value at the 
output side. However, the XYZ value on the output side 



is unpresumable in this stage, so the average relative 
luminance Yb at the output side is approximated by 
using the XYZ value on the input side. Also, the 
surround condition on the output side is Average 
Surround. Therefore, processing similar to step S29 is 
performed; the viewing condition parameter "larger than 
a field angle of 4 ° of a color chip" or "equal to or 
smaller than a field angle of 4° of a color chip" is 
set in accordance with the uniformity of a partial 
image in the adjacent region. 

Finally, color matching is performed by the CAM 
by using the viewing condition parameters at the input 
and output sides (S32), thereby calculating the 
output-side XYZ value corresponding to the input-side 
XYZ value. Steps S27 to S32 are repeated until it is 
determined in step S33 that analogous processing is 
completely performed for all pixels in the image. In 
this way, color matching is performed for the whole 
image . 

[Processing of Edge of Image] 

If a pixel of interest is set near the edge of an 
image as shown in Fig. 7, pixels in the stimulus region 
and the adjacent region are omitted in the process of 
step S29. Likewise, pixels in the background region 
are omitted in step S30. In a case like this, Ymax, 
Ymin, and Yb are obtained from effective pixels without 
processing these omitted pixels. 



As another method of preventing a lowering of the 
processing speed caused by determination of the 
presence/absence of omission of pixels near the edge of 
an image, a value such as Y = 100, Y = 20, or the 
relative luminance of the surrounding region can be set 
for an omitted pixel (as an omitted pixel) in 
accordance with the frame or the ambient situation of 
an assumed image. In this manner, processing can be 
performed without any omitted pixels. 

As described above, the first embodiment can 
achieve the following effects. 

(1) By using the distance D between an image and a 
viewer and the resolution R of the image, regions 
having different field angles (e.g., 2°, 4°, and 10°) 
with respect to a pixel of interest can be defined on 
the image. 

(2) a circular region with respect to a field angle 
is approximated to a square region in an image. This 
can increase the speed of processing in that region. 

(3) By calculating the uniformity Sp at a field angle 
of 4° or less in an image, it is possible to determine 
which of "larger than a field angle of 4° of a color 
chip" or "equal to or smaller than a field angle of 4° 
of a color chip" is to be used as a viewing condition 
parameter of Average Surround. 

(4) By calculating the average relative luminance Yb 
of the background region with respect to a pixel of 



interest in an image, this value can be set as a 
viewing condition parameter for the pixel of interest. 
(5) In processing near the edge of an image, a 
specific value (e.g., Y = 100, Y = 20, or the relative 
luminance of the surrounding region) is set for omitted 
pixels in the adjacent region and the background region. 
This can increase the speed of the processing near the 
edge . 

Second Embodiment 

An image processing apparatus of the second 
embodiment according to the present invention will be 
described below. In the second embodiment, the same 
reference numerals as in the first embodiment denote 
the same parts, and a detailed description thereof will 
be omitted. 

In the first embodiment, an image object or a 
rasterized object has been primarily explained. In the 
second embodiment, color matching mentioned above is 
applied to a graphical object before rasterization. 

Average relative luminance Yb of the background 
region can be obtained by analyzing the order of 
overlap of objects, and referring to colors in the 
objects and the colors of objects in the background in 
accordance with the sizes of the objects. A method of 
determining whether "larger than a field angle of 4° of 
a color chip" in the case of Average Surround will be 
explained as an example. 



Fig. 8 is a flow chart showing the process 
configuration of the second embodiment. 

First, a vector image to be displayed on a 
monitor or printed out is input (S71) , and the type of 
5 the input object is detected (S72 to S75) . If the 

input object is not detected as any object, the process 
is terminated by displaying an error message (S76) . 
M • If input object is text object or closed loop 

Cl object 

|f! 10 In this case, processes corresponding to steps 

1-/3 S21 to S2 6 shown in Fig. 3 are performed in 

s initialization (S77) to predetermine a region (adjacent 

region) corresponding to a field angle of 4° and a 

surround condition. 
H- 15 Subsequently, whether the surround condition is 

an* 

Average Surround is checked (S78). If the condition is 
Average Surround, a rectangle containing the object is 
calculated for simplification, and whether this 
rectangle is larger than the region having a field 

20 angle of 4° is checked. That is, a rectangle 

containing the object as shown in Fig. 13 is extracted 
(S79) . This rectangle containing the object is 
compared with a square {equivalent to Lpp =87 pixels 
if D = 0.5 m and R = 72 ppi) having a field angle of 4°, 

25 thereby optimizing a viewing condition parameter for 
the object (S80) . 

More specifically, in the process of step S80, if 
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both longitudinal and lateral sides of the rectangle 
are larger than Lpp, it is determined that "larger than 
a field angle of 4°". If one of the longitudinal and 
lateral sides is shorter, the analysis is further 
5 advanced. If the short side of the rectangle ^ 0.8 x 

2 

Lpp and the area is larger than the region (Lpp/m ) 
having a field angle of 4°, it is determined that 
"larger than a field angle of 4°"; if not, it is 
Cl determined that "equal to or smaller than a field angle 

III 10 of 4°". Note that this determination is applicable 

fit 

Si only when the text or the closed loop is painted with a 

jj single color. To increase the accuracy of the 

i a determination, it is also possible to calculate the 

lit area (occupied ratio) of a region actually painted in 

';! v : f 
;» s 

^'j 15 the rectangular region containing the object. 
H • If input object is image object 

In this case, a viewing condition parameter is 
optimized by processes equivalent to steps S21 to S31 
shown in Fig. 3 (S81) . 
20 • If input object is line object 

When this is the case, the possibility of "larger 
than a field angle of 4° of a color chip" is low. 
Therefore, the process of optimizing a viewing 
condition parameter is skipped. 
25 When a viewing condition parameter for each 

object is set by the above processing, color matching 
by a CAM is performed (S82) . The processes from steps 
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S72 to S82 are repeated until it is determined in step 
S83 that all objects are completely processed. In this 
way, color matching of the whole vector image is 
completed . 

By thus detecting objects, processing for a field 
angle can be performed not only for a raster image but 
also for a vector image. 
Third Embodiment 

An image processing apparatus of the third 
embodiment according to the present invention will be 
described below. In the third embodiment, the same 
reference numerals as in the first embodiment denote 
the same parts, and a detailed description thereof will 
be omitted. 

In step S21 of Fig. 3, a user inputs a distance D 
between an image and a viewer. This process can be 
automated by the use of a distance measurement sensor. 
As an example, a distance measurement sensor which 
measures a distance on the basis of the reflection time 
of infrared radiation is placed on a monitor or a 
viewing box (Fig. 9) . 

If a measurement sensor is difficult to install 
or is not connected to a host, the distance D can be 
manually set. It is of course also possible to input a 
numerical value (distance) displayed on a measurement 
sensor when the sensor is offline (not connected to a 
host machine) . 
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Furthermore, in processing near the edge of an 
image, a relative luminance value for an omitted pixel 
can be set by a user interface shown in Fig. 10. 
Although a default value is 20%, 100% can be set when 
the background is white, and an ambient relative 
luminance value can be set for a frameless image. If 
an actual relative luminance value is obtained, a 
custom value can also be input. 

As described above, the distance D between a user 
and an original, monitor, or printed product can be 
accurately set by the use of a distance measurement 
sensor. 

Modification of the First and Second Embodiments 

In each of the above embodiments, the 
magnification of an image is not changed. However, a 
viewing condition parameter can also be set in 
accordance with zoom magnification Z. For example, if 
the sides of the stimulus region, adjacent region, and 
background region with respect to a direct image are 
Lap, Lpp, and Lbp, respectively, when the distance D 
between an image and a viewer and the resolution R of 
the image are given, the sides of these regions with 
respect to the zoom magnification Z are given as 
follows on the original image if the distance D is 
fixed. By using these values in the aforementioned 
processing, the processing can be controlled even when 
the magnification of the image is changed. 
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Lap' = Lap x (1/Z) 

Lpp' = Lpp x (1/Z) 

Lbp' = Lbp x (1/Z) 
Fourth Embodiment 

An image processing apparatus of the fourth 
embodiment according to the present invention will be 
described below. In the fourth embodiment, the same 
reference numerals as in the first embodiment denote 
the same parts, and a detailed description thereof will 
be omitted. 

In the fourth embodiment , processing of detecting 
Ymax and Ymin and processing of calculating average 
relative luminance Yb of a background region in the 
above-described embodiments are executed at a high 
speed. 

[Detection of Ymax and Ymin in Adjacent Region] 

For processing of calculating uniformity Sp in an 
adjacent region in an image (step S29 in Fig. 3), 
whether a field angle of 4 ° or less can evenly be 
approximated to one color chip is determined. That is, 
calculation need not always be performed using a 
relative luminance Y. 

For example, Rmax, Rmin, Gmax, Gmin, Bmax, and 
Bmin are obtained in an adjacent region in association 
with the channels of an RGB image, and uniformities in 
the channels, i.e., Spr = (Rmax - Rmin)/100, Spg = 
(Gmax - Gmin)/100, and Spb = (Bmax - Bmin) /100 fall 
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within a threshold value, the adjacent region can be 
regarded as a uniform region. In this embodiment, an 
example in which Ymax and Ymin are detected on the 
basis of luminance information while neglecting 
chromaticity information for the sake of simplicity 
will be described. 

The relative luminance of each pixel is expressed 
by Y(i,j) . 

First, for an adjacent region with respect to the 
first pixel of interest, Ymax and Ymin are calculated 
in the following manner and stored in a memory as lists. 

Ymax(*,j) = MAX{Y(l,j), Y(2,j),..., Y(i,j),..., 
Y(Lpp, j) } 

Ymin(*,j) =MIN{Y(l,j), Y(2,j),..., Y(i,j),..., 

Y(Lpp, j) } 
for 1 < j < Lpp 

Subsequently, Ymax and Ymin for the first pixel 
of interest are calculated by 

Ymax(*,*) = MAX{ Ymax Ymax <*, 2) , . , 
Ymax(*, j) , . . . , Ymax (*, Lpp)} 

Ymin(*,*) = MIN{Ymin(*,l) , Ymin (*, 2) , . . . , 
Ymin(*, j) , . . . , Ymin (*, Lpp) } 

However, if the above arithmetic operations are 
applied to each pixel of interest, the quantity of 
calculation impractically becomes enormous. Hence, 
from the second pixel of interest, arithmetic 
operations are performed only for a difference region 



as shown in Fig. 11 to increase the processing speed. 

When processing shifts to the second pixel of 
interest, Ymax(*,l) falls outside the adjacent region 
and becomes unnecessary. Hence, Ymax(*,l) is deleted 
from the list of Lpp luminances Ymax(*,j) stored in the 
memory, and subsequent Ymax(*,2) to Ymax (*, Lpp) are 
updated to Ymax(*,l) to Ymax ( * , Lpp-1 ) . Similarly, 
Ymin(*,l) is also deleted from the list, and Ymin(*,2) 
and subsequent values are updated. Next, for the 
second pixel of interest, Ymax (*, Lpp) and Ymin (*, Lpp) 
are calculated for the hatched region shown in Fig. 11 
and added to the lists. 

Like the case of the first pixel of interest, 
Ymax and Ymin are calculated to obtain Ymax and Ymin 
for the second pixel of interest. 

Ymax(*,*) = MAX { Ymax ( * , 1 ) , Ymax <*, 2) , . . . , 
Ymax ( * , j ) , . . . , Ymax ( * , Lpp ) } 

Ymin<*,*) = MIN{ Ymin (*, 1) , Ymin (*, 2) , . . . , 
Ymin(*, j) , . . . , Ymin (*, Lpp)} 

The same arithmetic operations as described above 
are sequentially performed and repeated until the pixel 
of interest reaches the end of the scan line. For the 
next scan line as well, the arithmetic operations are 
performed for an entire adjacent region about the first 
pixel of interest, and only for the difference in 
relation to the second and subsequent pixels of 
interest. 
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As the values of omitted pixels in edge-side 
processing, values set by the above-described method 
are used. 

[Calculation of Average Relative Luminance Yb in 
5 Background Region] 

Increasing the speed of processing of calculating 
the average relative luminance Yb in a background 
, : region of an image (step S30 in Fig. 3) will be 

described next. 

|I| 

10 First, for the first pixel of interest, the 

H average relative luminance Yb in the background region 

:: 

A (including no adjacent region) is obtained. Let Nbp be 

y* the total number of pixels in the background region and 

f|f. Npp be the total number of pixels in the adjacent 

fi\ 15 region. Then, the average relative luminance Yb in the 
background region can be obtained from the difference 
between the "sum of relative luminances of pixels in 
the background region" and the "sum of relative 
luminances of pixels in the adjacent region". 
20 Yb - l/(Nbp - Npp) x {Ybp(*,*) - lYpp (*,*)} 

where Ybp (*,*): sum of relative luminances of 

pixels in background region 
Ypp (*,*): sum of relative luminances of 
pixels in adjacent region 
25 Ybp(*,j) =Z{Y(l,j), Y(2,j),..., Y(i,j),..., 

Y (Lbp, j ) } 

Ybp(*,*) =I{Y(*,1), Y(*,2),..., Y(*,j),..., 



- 26 - 



Y(*, Lbp) } 

Ypp(*,j) =I{Y(l / j) / Y(2,j),..., Y(i f j) r ..., 
Y(Lpp, j) } 

Ypp{*,*) = £{Y(*,1), Y(*,2),..., Y(*,j),..., 
Y(*,Lpp) } 

As in detection of Ymax and Ymin in the adjacent 
region, if the above arithmetic operations are applied 
to each pixel of interest, the quantity of calculation 
impractically becomes enormous. Hence , from the second 
pixel of interest, arithmetic operations are performed 
only for a difference region as shown in Fig. 12 to 
increase the processing speed. 

When processing shifts to the second pixel of 
interest, Ybp(*,l) falls outside the background region. 
Hence, Ybp(*,l) is deleted from the list of Lbp 
Ybp(*,j) stored in the memory, and subsequent Ybp(*,2) 
to Ybp(*,Lbp) are updated to Ybp(*,l) to Ybp (*, Lbp-1) . 
Similarly, Ypp(*,l) is also deleted from the list, and 
Ypp(*,2) and subsequent values are updated. Next, for 
the second pixel of interest, Ybp (*, Lbp) and Ypp(*,Lpp) 
are calculated for the hatched region shown in Fig. 12 
and added to the lists. 

Like the case of the first pixel of interest, 
Ybp(*,*) and Ypp(*,*) are calculated to obtain the 
average relative luminance Yb in the background region 
of the second pixel of interest (see equations below) . 

Ybp(*,*) =X{Y(*,1), Y(*,2),..., Y(*,j),..., 
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Y<*,Lbp) } 

Ypp(*,*) = X{Y(*,1), Y(*,2),..., Y(*,j),..., 
Y(*,Lpp) } 

Yb = l/(Nbp - Npp) x {Ybp(*,*) - Ypp (*,*)} 
The same arithmetic operations as described above 
are sequentially performed and repeated until the pixel 
of interest reaches the end of the scan line. For the 
next scan line, the calculations are performed for an 
entire background region and entire adjacent region 
about the first pixel of interest, and only for the 
difference in relation to the second and subsequent 
pixels of interest. 

As the values of omitted pixels in edge-side 
processing, values set by the above-described method 
are used. 

As described above, in the fourth embodiment, the 
adjacent region of a pixel of interest, which is formed 
from the pixel of interest and neighboring pixels, is 
divided in each direction (i) perpendicular to the scan 
direction (j), and an analysis result is held. When 
the pixel of interest moves in the scan direction, 
processing is executed only for a difference region. 
The adjacent region of the pixel of interest is 
analyzed using the held result. That is, by using 
differential arithmetic operations, optimum viewing 
condition parameters for an image can be obtained at a 
high speed. 
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In the above embodiment, subtractions are used in 
using viewing condition parameters. The subtractions 
can also be applied to another image correction if 
image condition parameters are obtained by analyzing 
5 the pixel values in an adjacent region. The analysis 
can be applied not only to maximum and minimum values 
but also to any other values such as an average value 
or cumulative value. 

As many apparently widely different embodiments 
10 of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
claims . 

15 The present invention can be applied to a system 

constituted by a plurality of devices (e.g., host 
computer, interface, reader, printer) or to an 
apparatus comprising a single device (e.g., copy 
machine, facsimile) . 

20 Further, the object of the present invention can 

be also achieved by providing a storage medium storing 
program codes for performing the aforesaid processes to 
a system or an apparatus, reading the program codes 
with a computer (e.g., CPU, MPU) of the system or 

25 apparatus from the storage medium, then executing the 
program. 
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In this case, the program codes read from the 
storage medium realize the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy 
disk, a hard disk, an optical disk, a magneto-optical 
disk, CD-ROM, CD-R, a magnetic tape, a non- volatile 
type memory card, and ROM can be used for providing the 
program codes. 

Furthermore, besides aforesaid functions 
according to the above embodiments are realized by 
executing the program codes which are read by a 
computer, the present invention includes a case where 
an OS (operating system) or the like working on the 
computer performs a part or entire processes in 
accordance with designations of the program codes and 
realizes functions according to the above embodiments. 

Furthermore, the present invention also includes 
a case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is inserted into the computer or in a memory 
provided in a function expansion unit which is 
connected to the computer, CPU or the like contained in 
the function expansion card or unit performs a part or 
entire process in accordance with designations of the 
program codes and realizes functions of the above 
embodiments . 
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